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ABSTRACT 



Probabilistic models are developed to analyze systems consisting of 
identical units or machines that require service at random intervals be- 
cause of chance failures of the units. The units in the system are as- 
sumed to be serviced by a maintenance system that does not have the tech- 
nical capability or equipment to restore all possible types of failures 
that a unit might suffer. 

The models reflect the performance of a system by describing the 
number of units operating, being repaired, or incapable of being repaired 
as a function of time, commencing with time zero when it is assumed that 
all units are operating. The models are capable of treating situations 
for which the maintenance limitations servicing the system are constant 
with time or change with time. The addition of spare units to back up 
the operating units is also analyzed. 
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TA n LE OF SYMBOLS AND ABBREVIATIONS 



<n 

*(t) 

K(t) 

H' 
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W(t) 

x(t) 

Y(t) 

U(t) 

m 

n 



: Constant repairable failure rate 

: Constant nonrepairable failure rate 

: Time-dependent nonrepairable failure rate 

r t 

: \ ^(u) du 

1 0 

: Constant mean repair rate 

s \ /Vc. 

: « / 'X 

: Time expressed in units of the mean time between repairable 

failures ( s = 'X t ) 

: Stochastic process representing the number of units in 

operational status at time t 

: Stochastic process representing the number of units in 

repair status at time t 

: Stochastic process representing the number of units in 

nonrepairable status at time t 

: Stochastic process representing the number of units in 

operational status or repair status at time t 
( U(t) = W(t) + X(t) ) 

: Number of units in operational status at time zero ( t = 0 ) 

: Number of spare units available at time zero ( t = 0 ) 
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Section 1 



Introduction 

The analysis of a system consisting of identical units or machines 
requiring service because of failures of the units at random intervals 
is a subject t^at has received extensive attention in the literature of 
operations research. 

The general approach to analyze a systems of units has been to 
analyze what is called the "machine interference" problem. The machine 
interference problem is defined as the effect, on the performance of 
the system, of delayed service to units requiring repairs. The delayed 
service occurs when a number of units are being repaired simultaneously, 
employing all the maintenance personnel, so that new units that suffer 
failures cannot be worked on immediately. Papers by Ashcroft (2), 

Benson and Ccoc ( 4 ), Benson ( 5 ), Benson and Gregory (6), Naor (12 and 13 ) 
and Phipps (14) may be referred to for detailed discussion and analysis 
of the machine interference problem. 

The approach of the machine interference problem also has been 
amplified to analyze the effect of the addition of spare units to the 
system of operating units. Spare units Eire used to replace units that 
require repairs so as to keep the number of operating units constant. 
Papers by Taylor and Jackson (l 5 ) and Ashar (l ) may be referred to for 
detailed descriptions and analysis of systems with spares. 

This paper considers another aspect of a system of units which 
occurs when the maintenance system servicing the units does not have the 
technical capability or equipment to restore all possible types of fail- 
ures that a unit might suffer. Situations for which maintenance limita- 
tions of this type might occur are advanced air bases or communications 
facilities; or operation of shipboard equipment while at sea. 
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It is emphasized that the analysis of a system serviced by mainte- 
nance systems with limited capability to repair all failure types differs 
from the previous machine interference problem and analysis of a system 
with spares because of this assumption of maintenance limitations. In 
the machine interference problem and the system with spares, the mainte- 
nance system servicing the units in the model is assumed to be capable 
of repairing all failure types that a unit might suffer and the only 
maintenance limitations occur when the maintenance system is saturated 
with repair work and cannot repair new failures immediately. 

Mathematical analysis, similar to the analysis used in the machine 
interference problem, is used to develop probabilistic models that pre- 
dict the performance of the system insofar as the number of units oper- 
ating as time of the analysis progresses. 

In the analysis, the failures which the units in the system suffer 
are assumed to be chance or random failures only as contrasted with early 
failures or wearout failures. Chance failures are caused by random over- 
stresses of the components in the units such as random current spurts in 
electronic components. For this reason, it is impossible to anticipate 
chance failures and such failures are said to occur independent of the 
time of operation of a unit. However, chance failures may be character- 
ized by a constant average failure rate and an exponential distribution 
of uninterrupted operating time of an individual unit until a chance 
failure occurs. 

In order to introduce maintenance limitations into the analysis, the 
failures of units in the system are assumed to be strictly differentiable 
into two classifications. These classifications are defined as: 

Repairable Failures : Chance failures which can be repaired by the 

maintenance system servicing the units 
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Nonrepairable Failures : Chance failures which cannot be repaired by 

the maintenance system servicing the units 

Section 2 presents a general model to analyze a system consisting of 
m identical units operating simultaneously . In this general model, both 
the repairable and nonrepairable failures are assumed to be chance fail- 
ures . Time required to restorerepairable failures is assumed to be ex- 
ponentially distributed. 

Section 3 analyzes the effect on the general model of Section 2 when 
the nonrepairable failures are characterized by an average failure rate 
which is a function of time as compared to the constant average failure 
rate assumed in the general model. The interpretation of this time- 
dependent average failure rate is that it represents a change in mainte- 
nance capability within the system as time of the analysis progresses. 

Section 4 analyzes the effect on the general model of Section 2 
when n spare units are added to the m operating units. 

Section 5 is an example application of the general model and the two 
special cases of the general model to analyze the operation and reliabil- 
ity of six pieces of identical radio equipment aboard a destroyer at sea. 

This thesis was written at the U. S. Naval Postgraduate School, 
Monterey, California, during the period January-May, 1962. The writer 
wishes to express his appreciation to Professor R. R. Read for his assist- 
ance, encouragement and most capable guidance while acting as faculty 
advisor for the writing of this paper. 
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Section 2 



Development of the General Model 
2.1 Approach to the Model 

Figure 2.1 is a block diagram of the general model that is developed 
to analyze a system consisting of m identical units. The m units suffer 
chance or random failures and are serviced by a maintenance system which 
does not have the technical capability or equipment to restore all possi- 
ble typos of chance failures which a unit might suffer. 

The model analyzes the distribution of the m units into three clas- 
sifications as time progresses. These classifications are defined to be: 

1 ) Operational Status: A unit is considered in operational 

status during the time the unit is operating or capable of oparatingp and 
during what is called scheduled down time when preventive maintenance and 
routine servicing is performed on the unit. 

2) Repair Status: A unit is considered in repair status from 

the time the unit suffers repairable failure until repairs are affected 
and the unit is restored to operational status. 

3 ) Nonrepairable Status : A unit is considered in nonrepayable 

status from the time the unit suffers a nonrepairable failure. Once a 

v 

unit enters nonrepairable status, the unit remains in that classification 
thereafter. 

It is assumed that at the commencement of the time of analysis, all 
m units in the system are operational. As time passes, units suffer re- 
pairable failures, leave operational status, are repaired and return to 
operational status. Simultaneously a unit may suffer a nonrepairable 
failure at any time of the analysis which places the unit in nonrepairable 
status. 

Three probability distributions characterize the time individual 
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Figure 2.1 Block Diagram of General Model 
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units remain in the three classifications. These three probability dis- 
tributions are: 



1 ) A(t) : The conditional distribution of time until a repair- 

able failure occurs to an individual unit in opera- 
tional status. 

A(t) = P( time an individual unit remains in operational 

status ^ t f given the unit does not suffer a nonre- 
pairable failure during this time ) 

2) R(t) : The conditional distribution of time to restore a 

repairable failure of an individual unit. 

R(t) = P( time to repair a repairable failure of an individ- 



ual unit ^ t, given the unit does not suffer a nonre- 



■ >htL ' 






pairable failure during this time )' 7 .< -fs 

A? //*- * *-*■ f U . , 

3) F(t) : The distribution of time until a nonrepairable failure 



occurs to an individual unit. 

F(t ) = P( time until an individual unit suffers a nonrepair- 

t</ ,, •' • •%. A ' v / 

able failure ^ t ) '/ i iftr* • 

A(t) is assumed to be an exponential distribution consistent with 
the assumption that the repairable failures that occur to units in the 
system are all chance or random failures. The parameter of the distribu- 
tion is 'x , the repairable failure rate, and is assumed to be constant, 



J- 



-V" 



independent of time. Therefore: 

A(t) =e - * 1 



3 

Because of the nature of the exponential distribution, l/* is the mean 
time between repairable failures or the expected time a unit will operate 
until a repairable failure occurs. 

R(t) is assumed to be an exponential distribution as a matter of 
convenience to simplify the mathematics required to solve the equations 
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describing the system. The parameter of the distribution is , the mean 
repair rate, and is assumed to be constant, independent of time. There- 
fore: 

M 

R(t ) = e " ^ 

A 

Because of the nature of the exponential distribution, l/^u. is the expected 
time to restore any single failure. 

R(t) includes the entire period of time from the time a unit suffers 
a repairable failure until the time the unit is restored to operational 
status, including the repair of any secondary repairable failures which 
occur during the repair of the original failure. Two interpretations are 
possible for R(t). One is that R(t) is the distribution of time that 
repair personnel actually work on a unit to restore the failure and any 
secondary failures. This interpretation assumes that there is no delay 
between the time a unit suffers a failure and the time maintenance person- 
nel commence repairs. This requires that detection of failures be, essen- 
tially, instantaneous and that the number and equipment of the maintenance 
personnel is sufficient to rep>air any number of units that may require 
service simultaneously. The second interpretation is that R(t) includes 
the delay a unit may have before rejmirs begin as well as the time that 
maintenance personnel need to restore the unit to operational status. 
Insofar as the model is developed, either interpretation is possible. 

F(t) is assumed to be an exponential distribution consistent with 
the assumption that the nonrepairable failures that occur to units in the 
system are all chance or random failures. The parameter of the distribu- 
tion is (<; , the nonrep>airable failure rate, and is assumed to be a con- 
stant, independent of time. Therefore: 

F (t ) = e “ t 

f\ 

Because of the nature of the exponential distribution, l/^ is the mean 
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time between nonrepairable failures or the expected time a unit will 
operate until a nonrepairable failure occurs. F(t) acts on units both 
in operational status and in repair status so that units may suffer non- 
repairable failures while in either classification. 

To describe the system with m units, the terminology of stochastic 
processes is used. Stochastic processes are defined to represent the 
number of units in each classification at a particular time t. The 
stochastic processes are: 

W (t ) : A stochastic process representing the number of units 
in operational status at time t. 

X(t) : A stochastic process representing the number of units 
in repair status at time t. 

Y(t) : A stochastic process representing the number of units 
in nonrepairable status at time t. 

Knowledge of any two of the three stochastic processes at a specific 
time t is sufficient to infer the value of the third process because of 
the constraint that any time t, W(t) + X(t) + Y(t) = m. 

The mathematical analysis of the system with m units is accomplished 
by a system of differential equations which represent the three stochastic 
processes, in a probabilistic sense, as a function of time. When the sys- 
tem of differential equations is solved, the marginal probability function 
of each stochastic process at any time t and the joint probability func- 
tion of any two of the stochastic processes at the same time can be deter- 
mined. Joint probability functions for two of the stochastic processes 
at different times are not solved. 

2.2 Summary of Equations 

The details of the derivation of the equations of the general model 
may be found in Appendix A. Generally, it is observed that the model's 
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solution is a multinomial or "trinomial" distribution. This multinomial 
distribution partitions the m units into the three classifications repre- 
sented by W(t), X(t) and Y(t) according to probabilities which change with 
time from time zero when it is assumed that all m units were in operational 
status ( i.e., W(0) = m; X(0) = 0; Y(0) = 0. ) 

Equations of the General Model 

a ) Marginal Probability Mass Functions 
P w (w;t) : probability mass function of W(t) at time t 



Pw 



: P( W(t) = w ) 



(v,t) = { 



v x e 



V t ' 






'r v v - ur 



p (x;t) r probability mass function of X(t) at time t 

A 



: P( X(t) = x ) 






p Y ( y j t ) : probability mass function of Y(t) at time t 
: P( Y(t ) = y ) 



P Y (y;t)= 



b) Joint Probability Mass Function 

P xy ( x »y*t) : joint probability mass function X(t) and Y(t) at time t 
: P( X(t) = x, Y(t ) = y ) 

= — \_-^rrr - 

i ' 



- u 



-x €> 



e 

-V>V*V^ ^ 



c ) Expected Value of Stochastic Process at any Time t 
E( W(t) ) : the expected value, in the probabilistic sense, of the 
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stochastic process W(t) at time t 



E( W(t) ) 
E( X(t) ) 

E( X(t) ) 
E( Y(t) ) 






/ 0 ~ ^ \ / - ( X-V y-') ^ 



y-)*- 



the expected value, in the probabilistic sense, of the 
stochastic process X(t) at time t 



Ui— 

\ \ r (-*■ 






\ - e 



- VA * 



the expected value, in the probabilistic sense, of the 
stochastic process Y(t) at time t 



E ( Y(t) ) = \ - e ** ) 

d ) Cumulative Probability Functions 
Py (w;t ) : cumulative probability function of W(t) at time t 

v 

Py(w}t) = P( W(t ) ^ w ) = ^_ p,.(u;t ) 

W u=0 ^ 

PyCyjt ) : cumulative probability function of Y(t) at time t 

7 

P Y (y;t) = P( Y(t)^y ) = PyCujt) 

P x (x;t) : cumulative probability function of X(t) at time t 

x 

P x (x;t) = P( X(tUx ) = H p^ujt) 

u=0 

2.3 Discussion of the General Model 

The general model may be applied to the analysis of systems of units, 
serviced by a complete spectrum of maintenance capabilities. This spec- 
trum of maintenance capabilities includes the following categories: 

(l ) Perfect Maintenance: All failures are repairable by the 

maintenance personnel servicing the system. In this case is equal to 
zero. 
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(2) Limited Maintenance: Failures occur that are repairable and 



that are nonrepairable . In this case 'X and ^ are finite, nonzero quantities. 

(3 ) No Maintenance : All failures that occur are nonrepairable 
(i.e., there is no maintenance capability servicing the system). In this 
case x and m- are equal to zero. 

In order to examine the general model to determine the model's sensi- 
tivity to its parameters, the parameters are combined to minimize calcula- 
tions and reduce the number of parameters to be considered. As will be 



seen, no generality is lost by combining the parameters. 



,X 



Time is transformed into integral units of the mean time between re- 
pairable failures using the equation: 

s = Xt ? \ Z 

Then let: 

£ = */m- <5 = 

Using these transformations, the marginal probability mass function 
of W(t) becomes: 



P w (wjt) = P( W(t) = w ) = P( W(s) = w ) = p w (v;s) = 






>rv^ - w- 



•> 



The expected value of W(s) at time s is defined by: 

e( w(s) )= ^ 

Similar results are obtained when these transformations are applied 
to the equations of X(t) and Y(t). 

The probability statements of the general model are reduced, by these 
transformations, to functions of four variables. These four variables are: 

(si* 

m, the number of units in the system; £ ; £ and time represented by s. 

In order to investigate the effect of the variables of the model on 
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the behavior of the model as time passes, the quantity E( W(s) ) will be 

/ 

calculated versus time, s,'for different values of £ and Q . E( W(s) ) 
will be expressed as a fraction of the total number of units in the sys- 
tem (m). This avoids the specification of a specific value for m in the 
investigation of the behavior of the model as time passes so that only 
the variables £. and <o need be considered. 

First a simple example will be considered to indicate how the behav- 
ior of systems of identical units differ when the maintenance capability 
servicing these systems is varied over the complete spectrum of mainten- 
ance capability from one extreme of perfect maintenance to the other 
extreme of no maintenance. 

Figure 2.2 is a graph of E( W(s) ) for systems of m identical units 
serviced by perfect maintenance (Case I), limited maintenance (Case II ), 
and no maintenance (Case III). For this example the variables £ and £ 
are assumed to have the following values in each case: 





L 


e 


Perfect Maintenance 


0.2 


0 


Limited Maintenance 


0.2 


0.25 


No Maintenance 


0 


oo 



Time, the abscissa of the graph, is in integral units of the mean 
time between failures. In the cases of perfect maintenance and limited 
maintenance, the mean time between repairable failures is the unit of the 
time scale while in the case of no maintenance, the mean time between non- 
repalrable failures is the time unit. 

From Figure 2.2 it is observed that in the case of perfect mainten- 
ance, E( W(s) ) assumes a constant value by s = .6 and does not change 
thereafter. T v is is statistical equilibrium for which the probability 
statements of the model become independent of time. A measure of how 
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fast a term achieves statistical equilibrium is given by the '’relaxation 
time” which is defined as the time required for the time dependent terms 
of the probability statements to decay to l/e of their original value. 

From the equation for E( W(s) ) the expression for the relaxation time 
may be determined to be: 

t r = c /( t + 1 ) 

Therefore in the example, the relaxation time is equal to .167 time 
units. Once statistical equilibrium is achieved, the time-dependent terms 
in the probability statements describing the model are negligible and the 
statements become independent of time. 

The case of no maintenance in Figure 2.2 is a curve for E( W(s) ) of 
the form of exponential decay. This is a result of the equation for 
E( W(s) ) which reduces, in this case, to an exponential decay equation 
with parameter <.< . 

The case of limited maintenance is a combination of the two extreme 
cases. The probability statements of the perfect maintenance model are 
multiplied by exponential terms to account for a reduction of available 
units as nonrepairable failures occur. Because of these exponential fac- 
tors, statistical equilibrium is achieved only after long periods of time 
when all m units are in nonrepairable status. 

Next the behavior of the general model is examined when the variables 
of the model are varied over a wide range of values. Since the model does 
not consider time loss due to delay in service to units requiring attention, 
values for the model's variables will be restricted to situations in which 
the number of units being repaired at any time s is small. This can be 
accomplished by using values for the variable £ which correspond to a max- 
imum value of E( X(s) ) for any time s which is less than or equal to as 
small a fraction of m as desired. 
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To investigate the behavior of the general model, values of .01, .1 
and .25 will be used for £ , which correspond to a maximum E( X(s) ) of 
.Olra, .09m and .2m respectively. For 9 , values of .1, .5 and 1 will be 
used which correspond to nonrepairable failure rates which are l/lO, l/2 
and equal respectively to the repairable failure rate. 

Figure 2.3 is a graph of the expected fraction of units in the model 
operational at any time s. (Time, the abscissa of the graph, is expressed 
in integral units of the mean time between repairable failures.) Several 
observations can be made from the graph. The behavior of the model, over 
periods of time greater than ,5s is more strongly affected by the value 
of 9 than by the value of £ . In fact, as approaches one, the curves 
for the three values of £ shrink closer to one another. This affect also 
increases as time progresses, being greater for large s than for small s. 

The initial slope of the curve for small s appears to be a function 
of both £ and . It appears that, given 9 is a constant, the initial 
slope of the curve will be greater for larger L. which seems reasonable 
since the total failure rate acting on all operational units will be 
larger . 

The form of the curves are of interest also. They are, of course, a 
combination of the perfect maintenance curve and the no maintenance curve 
depending on the amount of maintenance capability a system has which is 
denoted by £ . It is observed that for the small value of ^ (9.= .1 ), 

the curve becomes nearly a straight line. For the large value of 9 
(<2 = 1 ), the curve is nearly an exponential decay. The form of the curve 
then appears to indicate the amount of maintenance capability a system 
possesses. 
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Section 3 

The Effect of a Time -dependent Nonrepayable Failure 
Rate on the General Model 

3.1 Approach to the Modified Model 

An extension of the general model is to make the probability that an 
individual unit suffers a nonrepayable failure at any instant of time 
change as time of the analysis progresses. This can be accomplished by 
permitting the nonrepayable failure rate, fc. , to be a function of time. 

^ (t ) = Time -dependent Nonrepayable Failure Rate 

3.2 Equations of the Modified Model 

One case of the modified model which is useful in many applications 
occurs when ^(t), the time -dependent nonrepayable failure rate, is 
integrable . 

Let: 

r t 

K(t ) = \ ^ (u) du 

J 0 

The details of the derivation of the equations of the modified model 
for this case may be found in Appendix A. When V. (t ) is integrable, the 
equations of the modified model are identical with the equations of the 
general model except that the exponential term which had coefficient 
- kt in the general model will have that coefficient replaced by -K(t). 
Because of the similarity of the equations for this case with the equa- 
tions of the general model, the equations of the modified model will not 
be listed here. 

3.3 Discussion of the Model 

The modified model with a time-dependent nonrepayable failure rate 
is a more versatile model to approximate the behavior of a system of 
identical units than the general model developed in Section 2. Provided 
the function used to represent the time-dependent nonrepayable failure 
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rate, ^(t) is integrable, a wide variety of nonrepairable failure rates 
may be applied to the model. Because of the wide spectrum of functions 
which may be used to represent nonrepairable failure rates, it is diffi- 
cult to analyze the behavior of systems, in some degree of generality, 
which have time-dependent nonrepairable failure rates. One example of 
the use of a time-dependent nonrepairable failure rate may be found in 
the example application of the various models in Section 5. 

The choice of a function to use in a particular application depends, 
of course, on any information that is known about the situation which can 
be used to make estimates of the actual failure rates. Previous failure 
data and component failure data are examples of information which might 
be available. It would seem that in many applications, a polynomial of a 
particular degree would be sufficient to represent the failure rate, and 
the problem then becomes one of estimating the values of the coefficients 
of a polynomial. 

With the assumption that the nonrepairable failure rate is a func- 
tion of time, the maintenance capability servicing a system can be inter- 
preted as changing in capability as time progresses because spare parts 
are exhausted or replenished, test and repair equipment fails or is re- 
paired, maintenance personnel tire or are increased in numbers, ... etc. 
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Section 4 



The Addition of Spare Units to the General Model 
4.1 Approach to the Model with Spare Units 

In some situations it is desired to maintain a fixed number of units 
operating simultaneously. Then to keep the number of units that are op- 
erating equal to this fixed number, it might be desirable to have addi- 
tional, spare units available to replace units suffering nonrepairable 
failures . 

In this section the basic model is augmented to analyze the addition 
of n spare units to the system of m units. The assumptions of the model 
with spare units are: 

a) At time zero of the model (t=0), there are m units in opera- 
tional status and n idle, spare units. No more than m units are desired 
in operational status simultaneously. 

b) Units in operational status or being repaired obey the as- 

sumptions of the general model developed in Section 2 (the nonrepairable 
failure rate is independent of time.). < 

c) Spare units that are idle cannot suffer failures. When a 
spare unit is needed, the spare unit moves into operational status and 
thereafter obeys the same assumptions as any other unit. 

d ) Spare units are used to replace units suffering nonrepairable 
failures only. Spare units are not used to replace units being serviced 
or repaired. 

The model that is developed analyzes the distribution of the m + n 
units between two classifications as time progresses. These classifica- 
tions are: 

l) Nonrepairable Status: This classification is represented by 

the stochastic process Y(t) which represents the number of units in non- 
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repairable status at time t. 



2) Operational or Repair Status: This classification is repre- 

sented by the stochastic process U(t) which represents the number of units 



in operational status or repair status at time t. ( U(t)=W(t)+X(t) ) 
Knowledge of one of the two stochastic processes representing the two 
classifications is sufficient to infer the other because of the conditions 



These conditions result from the assumption that spare units are 
used to replace units that suffer nonrepairable failures only. 

4.2 Equations of the Model with Spare Units 

Details of the derivation of the equations of the model with spare 
units may be found in Appendix B. Because of the complexity of the 
probability expressions, only the marginal probability mass function and 
cumulative probability mass function for Y(t) were solved. Using the 
probability statements for Y(t), and knowledge of m and n, the probability 
mass function and cumulative probability function of U(t) were inferred. 



U(t) = m when Y(t)in 

U(t) = m + n - Y(t) when Y(t)>n 



(a) Probability Mass Function of Y(t) and U(t) 
Py(yjt) : probability mass function Y(t) 

: P( Y(t) = y) 




O t t ' TV - 






Py(n+1 ; t ) = 



e 




4 - 

e 






(n+2 J t ) = Vn_ ^ ^ - * ) 6 



- CfD > ) Cv -t 
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P Y (n+v;t) = 



[ 



— 




^ v-\ - r\r ) 

e 



V ^ \ ^ 



Pu (u;t) 



O L <\s L ' s o\^ 

probability mass function of U(t) 
P( U(t) = u ) 



PyUjt) = 
PyU-Vjt) 

P y (y}t) : 

P Y (y;t) = 

P g (ujt) : 

* 

» 

Pjj(u;t) = 



L p Y (yjt) 

y=0 Y 

= p^n+vjt) 0 ivtffl 

(b) Cumulative Probability Functions of Y(t) and U(t) 
cumulative probability function of Y(t) 

P( Y(t) <= y ) 

y 

H Py(vjt) 
v=0 

cumulative probability function of U(t) 

P( U(t H u ) 

io p « (T!t) 



4.3 Discussion of the Model with Spare Units 

The model that has been developed to analyze a system consisting of 
operating units backed up with spare units, although limited in applica- 
bility because of the restrictive nature of the model's assumptions, rep- 
resents a means to compare improvements in the reliability of a fixed 
number of operating units when backed up by any number of spare units. 

Because of the assumption that spare units are used to replace only 
units that suffer nonrepairable failures, optimum applicability of the 
model is to situations for which the expected number of units requiring 
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service simultaneously is a small fraction of the total number of oper- 
ating units. 

The assumption that spare units replace units that suffer nonrepair- 
able failures only has the effect of keeping the number of units in oper- 
ational or repair status (classification 2) equal to m, the number of 
units initially in operational status, as long as possible. Only if spare 
units are used both to replace units that suffer nonrepairable failures 
and units that suffer repairable failures, while repairs are affected, 
will the number of units in operational status only be kept equal to m 
as long as possible. 

It would be desirable to generalize the present model so that the 
utilization of spare units to replace units that suffer nonrepairable 
failures (while repairs are being affected ) could be analyzed . Then com- 
parisons could be made between different policies for the utilization of 
spare units, and the behavior of systems backed up by spare units could 
be analyzed for any policy for the utilization of spare units. 

Another assumption of the present model that restricts the applica- 
bility of the model is the assumption that idle units are not susceptible 
to failure. In real situations there is evidence that spare units suffer 
"shelf failures" which are random in nature. These shelf failures degrade 
the performance of a spare unit or cause the unit to fail altogether when 
needed. Nevertheless there are real situations for which the failure rate 
associated with idle spares is negligible and the present model can be 
applied . 

Case II of the example introduced in Section 2 (limited maintenance 
case ) will be used to demonstrate the improvement in system reliability 
that is achieved when a system is backed up by spare units. Using the 
same parameter values that were used in Section 2, the probability of m 
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units remaining in operational or repair status (classification 2) will 
be calculated versus time in units of the mean time between repairable 
failures for systems backed up by 0, 2, 4, and 6 spare units. In this 
example, m, the number of units initially operational, is equal to 10. 

Figure 4.1 is a graph of the resultant probability curves. From 
the graph, it is observed that in the case for which n = 0, the curve 
drops very rapidly and becomes negligible after s = 1.0. This is con- 
trasted by the case for which n = 6. In this case the curve remains at 
approximately 1 .0 until s = .5 and then drops at a slower rate than the 
curve for n = 0, and finally becomes negligible after s = 3.0. 
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Section 5 



An Example 

In order to understand how the three mathematical models developed 
in this paper can be applied to actual situations, a fictitious application 
of the three models to analyze the continued availability of identical 
radio equipment aboard a destroyer at sea will be considered. A ship 
while at sea represents a reasonable situation for application of the 
models because, in many instances, the maintenance capability of ship's 
personnel while at sea for the equipment aboard ship is of a limited 
nature. Further, the availability or reliability of equipment aboard 
ship as time at sea passes is of vital interest since it may determine 
how long the ship can remain at sea and still have equipment available to 
fulfill its mission. 

In the example, a system consisting of six identical pieces of radio 
equipment aboard a destroyer will be analyzed. It is assumed that because 
of physical arrangements aboard the ship only four of the six units can 
be used simultaneously. The ship is assumed to be engaged in extensive 
operations that require that four units be used continually if four units 
are available. However the ship is assumed to be capable of fulfilling 
minimum communication requirements with only two units. Therefore the 
situation may be summarized as a system consisting of six identical units, 
of which initially four units are operating and two units are spares. 

This system will be analyzed with the three models developed in this 
paper. It should be realized that to use the structure of any of the 
three models, the assumptions of the particular model that is to be applied 
must be studied carefully to ensure that the assumptions are consistent 
with the system that is to be analyzed. 

First the availability or reliability of just the four units that are 
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operating initially is analyzed and the two spare units are not considered. 
This situation may be analyzed with either the general model developed in 
Section 2 or the modified model developed in Section 3 depending on whether 
the nonrepairable failure rate is assumed to be independent of time or to 
be a function of time. 

The case for which the nonrepairable failure rate is independent of 
time is analyzed first, and the structure of the general model is applied. 
Parameter values of the system are assumed as follows : 

'X =0.25 repairable failures/day 
^ =2.00 repairs/day 

= 0.02 nonrepairable failures/day (i.e., n is a constant, 
independent of time) 

These parameter values are arbitrary and do not reflect the character- 
istics of any known radio equipment. The assumed values of the parameters 
correspond to values of £ and which are: 



* 0,25 

* = ~ = 2t00 = °‘ 12 5 






<2 = 



0.02 

= 0.25 



= 0.08 



Figure 5.1 is a graph of E( W(t) ), p^(4;t) and P( W(t) - 2 ) versus 
time from 0 to 60 days. The upper limit of the expected number of units 
being repaired at any time t (E(X(t) ) )in this case is .68 units. 

From the graph it is observed that while p^Ujt) drops rapidly, 

P( W(t ) - 2 ) decreases slowly, crossing 50% probability after about 38 



days . 

Next the case for which the nonrepairable failure rate is a function 
of time is analyzed. The same parameter values for the mean repair rate, 
p<_ , and the repairable failure rate, \ , are used. It is assumed that the 
nonrepairable failure rate is a combination of a simple time— independent 



26 




27 



mo ^^es, op optfiMioHM. 




failure rate and a simple time-dependent failure rate. Then: 

K (t ) = + e t 

K(t) = Kt + © t 2 /2 

The form of the nonrepairable failure rate may be interpreted as 
follows : 

represents the initial nonrepairable failure rate attributed 
to the limited maintenance capability at the beginning of the period at 
sea of the destroyer. 

© represents the rate of increase of the nonrepairable failure 

% 

rate as time at sea passes attributed to the increase of maintenance 
limitations as time at sea passes. 

In order to provide a basis for comparison between the case for which 
the nonrepairable failure rate is independent of time and this case for 
which the nonrepairable failure rate is a function of time, values for the 
parameters ^ and © are chosen so that the area under the curve of <s.t versus 
time for zero to sixty days in the first case is the same as the area under 
the curve of K(t) versus time for zero to sixty days in this case. The 
result of equalizing the area under the two curves is to make the proba- 
bility statements for t=60 days identical in either case. 

The parameter values are assumed to be: 
fc = ,005 nonrepairable failures/day 
G = .0005 nonrepairable failures/day/day 

Figure 5.2 is a graph of E( W(t) ), Py(4}t) and P( W(t)^ 2) versus 
time from 0 to 60 days for the case for which the nonrepairable failure 
rate is assumed to be a function of time. A comparison of Figure 5.2 with 
Figure 5.1 shows that the curves of Figure 5.2 are above the corresponding 
curves of Figure 5.1 until t approaches 60 days. When t approaches 60 
days, the curves begin to coincide. This observation is expected since 
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the nonrepairable failure rate in the time dependent case increases with 
time from a small initial value, as contrasted with the constant failure 
rate in the time independent nonrepairable failure rate case. 

This comparison between a time dependent and time independent fail- 
ure rate demonstrates the importance of the nonrepairable failure rate in 
the development of any analysis of a system serviced by limited maintenance. 
A particular choice of a function to represent the nonrepairable failure 
rate reflects both the nature of the limitations of maintenance on a sys- 
tem (constant or increasing) and the amount of maintenance limitations on 
the system when compared with the other parameters of the system. The 
effect of nonrepairable failures is greater, the longer the period of 
time the analysis is concerned with. Therefore, when a system is to be 
analyzed over extended periods of time, any nonrepairable failure rate 
present in the system could be significant and should be considered. 

Finally the entire system consisting of four operating units and two 
spare units is analyzed with the model of a system with spare units devel- 
oped in Section 4. Since the model of a system with spare units assumed 
that the nonrepairable failure rate was independent of time, the same 
parameter values used in the application of the general model in this 
example are used in this model. 

The model of a system with spare units analyzes the location of 
units as time progresses between two classifications only; one for units 
in operational or repair status, and the other for units in nonrepairable 
status. Therefore, to give a basis for comparison, the probability of 4 
units remaining in operational or repair status and the probability of at 
least 2 units remaining in operational or repair status are calculated 
for the case of no spares and the case of two spares. 
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Figure 5.3 is a graph of py(4}t) and P( U(t) - 2 ) versus time from 0 
to 60 days for the case of no spares and the case of two spares. From the 
graph, the improvement in system reliability is obvious. The curve of 
P( U(t)- 2 ) crosses 50 % probability at approximately 47 days for a system 
without spares as contrasted to approximately 57 days for a system backed 
up by two spare units. 
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Section 6 



Conclusions and Recommendations 

6.1 Conclusions 

(a) This paper presents mathematical models which analyze systems of 
identical units serviced by limited maintenance. A wide spectrum of real 
situations can be analyzed by the models developed including cases for 
which the maintenance capability remains constant with time, cases for 
which the maintenance capability changes with time and cases for which 
spare units are available to back up the operating units. 

(b) In the development of mathematical models, the choice of proba- 
bility distributions to represent the occurrence of nonrepairable failures 
is critical because of the significance of this distribution in the be- 
havior of the model. The comparison of the distribution of occurrence of 
repairable failures indicates the limitations of maintenance servicing a 
system. The change of the distribution of occurrence of nonrepairable 
failures as time passes indicates the change of maintenance capability as 
time passes. 

(c) From the limited application of the models developed in this 
paper in the example, it is apparent that any limitations in maintenance, 
however small, will degrade system reliability, particularly over long 
periods of time. When it is suspected that some maintenance limitations 
exist, provisions should be made to counter the effect of the corresponding 
degradation of operating units by providing spare units or an outside 
source of additional maintenance or units for the system. The models de- 
veloped in this paper are well-suited to predict requirements of spare or 
additional units consistent with specified probability standards of system 
reliability. 

(d ) While the reliability of a system of units serviced by limited 
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maintenance obviously is increased by the addition of spare units to the 
system, the reliability also can be increased by increasing the mainte- 
nance system servicing the system of units or by reducing the time to re- 
store repairable failures. Only by investigating all three methods of 
increasing system reliability, can the best method of improving system 
reliability be determined. 

6.2 Recommendations 

This paper represents a basic approach to the analysis of systems 
consisting of identical units serviced by limited maintenance. Limita- 
tions were imposed on the development of the mathematical models so as to 
avoid complex mathematics and resultant solutions which would be difficult 
to interpret. It seems reasonable to suppose that future efforts should 
be made to generalize the basic models developed in this paper so that 
wider application of the models would be possible. In particular models 
could be developed which use distributions other than the exponential 
distribution to describe failures and repair. The area of machine inter- 
ference could be extended to systems with limited maintenance. In the 
model of a system with spares, future models might consider the recommen- 
dations of Article 4.3 to permit spares to be used to replace units that 
suffer repairable failures as well as nonrepairable failures. A distri- 
bution could be introduced to characterize shelf failures of spare units. 

Further generalization of the models of this paper will involve the 
complex mathematics that this paper avoided. It is suggested that com- 
puter simulation might be an advantageous approach to study the complex 
situations. It would seem that systems of identical machines serviced by 
limited maintenance with or without back up spares worxld lend itself to 
simple computer simulation. The programs could be designed to simulate a 
wide spectrum of situations and the complex mathematics required to study 
the same systems analytically would be avoided. 



34 



Bibliography 



1 . Ashar, K. G. 


Probabilistic Model of System Opera- 
tion with Varying Degree of Spares 
and Service Facilities 
Journal of the Operations Research 
Society of America, September, i960, 
Volume 8 


2. Ashcroft, H. 


The Productivity of Several Machines 
Under the Care of One Operator 
Journal of the Royal Statistical 
Society, Series B, Volume XII, 1950 


3. Bazovsky, I. 


Reliability Theory and Practice 
Prentice-Hall, Inc., Englewood Cliffs, 
N.J., 1961 


4. Benson, F. and Ccoc, D. R. 


The Productivity of Machines Requiring 
Attention at Random Intervals 
Journal of the Royal Statistical 
Society, Series B, Volume XIII, 1951 


5. Benson, F. 


Further Notes on the Productivity of 
Machines Requiring Attention at Random 
Intervals 

Journal of the Royal Statistical 
Society, Series B, Volume XIV, 1952 


6. Benson, F. and Gregory, G. 


Closed Queueing Systems: A Generaliza- 
tion of the Machine Interference Model 
Journal of the Royal Statistical 
Society, Series B, Volume XXIV, 1961 


7. Bharucha-Reid , A. T. 


Elements of the Theory of Markov Pro- 
cesses and Their Applications 
McGraw-Hill Book Company, Inc., New 
York, 1960 


8. Feller, W. 


An Introduction to Probability Theory 
and Its Applications, Volume I 
John Wiley & Sons, Inc., New York, 
1950 


9. Kendall, D. G. 


Stochastic Processes and Population 
Growth 

Journal of the Royal Statistical 
Society, Series B, Volume XI, 1949 


10. Koenigsberg, E. 


Cyclic Queues 

Operational Research Quarterly, 
Volume 9, 1958 



35 



11. Koenigsberg, E. 


Finite Queues and Cyclic Queues 
Journal of the Operations Research 
Society of America, March 1960, 
Volume 8 


12. Naor, P. 


On Machine Interference 
Journal of the Royal Statistical 
Society, Series P, Volume XVIII, 
1956 


13. Naor, P. 


Normal Approximation to Machine 
Interference with Many Repairmen 
Journal of the Royal Statistical 
Society, Series B, Volume XIX, 1957 


14. Phipps, T. E. 


Machine Repair as a Priority Waiting- 
Line Problem 

Journal of the Operations Research 
Society of America, January 1956, 
Volume 4 


15. Taylor, J. and Jackson, R.R.P. 


An Application of the Birth and Death . 

Process to the Provision of Spare 

Machines 

Operational Research Quarterly, 

Volume 5, 1954 



36 



Appendix A 

Derivation of the Equations of the General Model of a System with Limited 
Maintenance for Constant Failure and Repair Rates and the Special Case for 
a Time-dependent Nonrepairable Failure Rate 
I The General Model with Constant Failure and Repair Rates 

Consider the system shown in Figure A.1 . This system consists of 
three boxes. A, B and C. In the system are m particles subject to the 
following transition probabilities: 

In any infinitesimal period of time, dt, any single particle in box 
A has probability 'A dt of moving to box B, probability dt of moving to 
box C and probability 1- (a + * )dt of remaining in box A. Similarly, any 
single particle in box B has probability h-dt of moving to box A, proba- 
bility (< dt of moving to box C and probability 1 - ( m. + t* )dt of remaining 
in B during the period dt. Any single particle that is in box C is effec- 
tively "trapped" since it cannot leave box C and remains in box C with 
probability 1 thereafter. 

These transition probabilities correspond to assumptions that: 

(a) The time a particle remains in box A until it moves to box 
B, given that it does not move to box C in this time, is exponentially 
distributed with parameter A . 

(b) The time a particle remains in box B until it moves to box 
A, given that it does not move to box C in this time, is exponentially 
distributed with parameter F 1 - . 

(c) the time a particle remains either in box A or box B until 
it moves to box C is exponentially distributed with parameter <s . 

One initial condition imposed on the system is that at time zero 
(t = 0), all m particles are in box A. 
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Figure A.1 System Consisting of m Particles Confined to Three Boxes 




To describe this system, a system of differential equations will be 
written. To do this, let the stochastic processes W(t), X(t) and Y(t) 
represent the number of particles in boxes A, B and C respectively at any 
time t. 

W(t), X(t) and Y(t) are subject to two conditions: 

(l ) At any time t, W(t) + X(t) + Y(t) = m. 

(2) At time t = 0, W(0) = m; X(0) = Y(0) = 0. 

At any time t, the system may be described exactly by the knowledge 
of any two of the three stochastic processes since the third process may 
be inferred from condition (l ) above. Let P( X(t)=x, Y(t)=y ) = p^ Y (x,yjt) 
be the probability that at time t, the system is in a state where 
X(t) = x and Y(t) = y. The system of differential equations will be 
written for these "system probabilities". In order to simplify the writing 
of the system of equations, p(x,y;t) will be used for p^Xjyjt). 
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The General Equation 




(x+y ) \ X 



+ X^c + 



(m - y j p(x,yjt ) 



+ (x + 1 ) ^ p(x+1 ,y;t ) 

+ l m ”V (x - 1 ) + y i } ^ p(x-1 ,y;t ) 
+ ^m-(y-l)}fc p(x,y-1;t) 

+ (x + 1 ) p(x+1,y-1;t) 

subject to: 

x + y m 



0 L - x k m 
0 t y k m 

and p(°( , ^ }t) = 0 whenever < < 0, 9 <. 0, ■< > m or 9 > m. 

To obtain a solution to the system of differential equations, we use 
probability generating functions. 

Let: 



G (r,s;t) = 

3G (r.s:t) = 
3 r 



X - O ^ - o 



22 s' 9 ^.V>M = 

\ - o O 



c 






a„G (r.s ;t_) = 
S s 



(r.s:t) = 
at 



'V/ U - \ 

LI 



^ o 



v-\ m, 

X ^ ^ 



P X I i ^ 




5*9 

C> ^ 






By multiplying each equation in the system by the appropriate s x r^ 
and adding all equations, a partial differential equation of the proba- 
bility generating function is obtained. 
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— m^XCs— 1) + ^ (r-1 )~\ G 
+ (l-s)^s + p- + (<*r G g 
+ rV'X(l“s)+ fc(l-r)"\ G r 

This partial differential equation is solved subject to three condi- 
tions : 

(l ) G (r,s;t ) x--. , =1 

(2) G (r,s;t ) ^ T -_, =1 

V - O 

(3) G (r,sjt )"\ s-- « =1 

t_ - O 

These three conditions correspond to the condition that the system 
probability mass function S’uns to one at any time t and to the initial 
condition that X(t) and Y(t) equal zero at time zero. 

The solution is: 



G (r,s;t) = i 


^ 'X * + 


+ “X e' u ‘ Kli ] 





This may be solved for the expected values E (X(t) ) and E( Y(t) ) 



E { X(t)) 



E 






^ ^ ’> ^ ) 
3S 



x' =- > 



s = \ 



x ^ k 









G 

^ ' v 



’T- - N 
S - \ 



- ^ 
e 



v - e ^ ^ 
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The joint probability mass function of X(t) and Y(t) for any t is: 
P ( X(t ) = x, Y(t) = y ) = Pxy (x,y;t) 



= U)r^) Ittt: V 



VA 1 * p-"> 



h- 



-fc- \ 

h*- i 












\ ^ \ X ) 



l' - e '^T te-^} 






Uh- L 0 



This formula can be verified by substitution into the probability 
generating function G( r, sj t) and showing it satisfied the partial 
differential equation that was developed. 

From the joint probability mass function marginal mass functions 
may be calculated for X(t) and Y(t). 

m-oc 

(x;t) = Y^_ p(x,y;t) 
y=0 



P \ X(t ) = x) = 




m-y 

p ^Y(t)= «a) = P Y (y;t ) = £1 p(x,y;t) 

= C?) 

Examination of the joint probability mass function shows that it is 
a multinomial distribution that distributes the m particles among the 
three boxes. Thus at any time t, a single particle will be in box A with 
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probability: 






X ■* p- 



- tx-v lO -t 

x e v 



in box B with probability: 



x e 






\ - e 






X -V- p- 

in box C with probability: 



\ - e 



<6-t 



Then the marginal mass function of the stochastic process W(t) will 



be: 



P ^W(t) = w) = T\j(y;t) 



(Z){ 



? \ xe r -v- u_ 

* v K L 



■i 



~\ 



ur 



x e 



- 



\^\ — g ~ bO ^ ^ ^ 



- ^O- 



The expected value of W(t) will be for any time t: 

*(•<*>)- h ) 

The marginal probability mass functions for W(t), X(t) and Y(t) are 

all identifiable as binomial distributions of the form: 

p(x) = ( m \ p* (l - pT”* 

VX } 

Then the equations of the binomial distribution are applicable. Two 
often used equations are: 

(l ) The Expected Value 
E(x) = mp 
(2) The Variance 

Var(x) = mp(l-p) 
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With the marginal probability mass functions for W(t), X(t) and Y(t) 
known, the cumulative probability functions for W(t), X(t) and Y(t) can 
be calculated from the following equations : 



P( W(t ) ^ w 


w 

) = p u(w;t) = 7 


P w (u;t) 




^0 




X 




P( X(t)4 x 


) = P x (x;t) = 


Pj^Ujt ) 




u=0 


P( Y(t)4 y 


) = P (y;t) = £ 

Y u=0 


p y (u;t) 
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II The Special Case of a Time -dependent Nonrepairable Failure Rate 

In Figure A.1, the movement of particles from box A and box B to box 
C describe a process which is a special case of a process commonly referred 
to as a simple death process. The special case of the process which the 
model develops may be thought of as a simple death process from a finite 
population. This death process continues independent of the position of 
the particles in box A or box B until all m particles have moved to box C 
where they are confined to remain thereafter. 

In the general model, it was assumed that during any infinitesimal 
period of time, dt, any particle in either box A or box b has probability 
6 dt of moving to box C where ^ is a constant, independent of time. A 
generalization of this phase of the model is to let l< be a function of 
time, K (t). Then the time a particle remains either in bcx A or box B 
until it moves to bcx C is exponentially distributed of the special form 
which permits the parameter of this distribution, k (t), to be a function 
of time. 

It is possible to derive the equations for the case of the time- 
dependent nonrepairable failure rate in the same manner as was used in 
part I of this appendix for the general model. However the only differ- 
ences that will be derived between the general model and the special 
model for the time-dependent nonrepairable failure rate will occur in 
the simple death phase of the model because of the nature of the basic 
model which assumes that particles movo to box C independent of their 
location in bcx A or box B and dependent only on the nonrepairable fail- 
ure rate K(t). The equations for the special case of the time -dependent 
nonrepairable failure rate can be derived by examining only the elements 
of the basic model which affect the simple death process. This approach 
has the advantage of indicating any conditions imposed upon the function 



44 



^ (t) in a direct manner, and will be used therefore. 
Figure A. 2 Simple Death Process of Basic Model 




Figure A. 2 shows the model that will be analyzed. It should be noted 
that the boxes A and B are combined into one box which is described by the 
sum of the stochastic processes W(t) and X(t). 

A system of differential equations will be written describing Y(t) at 
any time t. Therefore the "system probabilities" for this system of equa- 
tions will be P( Y(t)=y )= Py(y»t). In order to simplify the equations, 
p(yjt) will be used for p^(y;t). 

The General Equation 

^ p(ytt) = - (m-y) fc. U) p(y;t) 

3 t 

+ ^m - (y-1 ) ^ ^ p(y-ljt) 

subject to: 0 t y t m 

and p( W jt) = 0 whenever 4 ^ 0 or < > m. 

One initial condition imposed the system of equations is: 

Y(0) = 0 

Therefore: P( Y(0) = 0 ) = p(0;0) = 1 
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This system of equations may be solved by successive reiteration of 
the system starting at p(0;t), or by the use of probability generating 
functions. Generating functions will be used: 

Let: 



f (s;t ) = XI p(y;t) = F 

y=° 



m 

a f (s ; t) = XI ys 7 ” 1 p(y;t) = f 

■3 s y=0 



l (s:t) = X 3 y 3 p(y:t) = F 
3 1 y=0 3 1 

By multiplying each equation in the system by the appropriate s^ and 
adding all the equations, a partial differential equation of the probabil- 
ity generating function is obtained. 

F^ = ^ ^ X - v V -v \ - s X F s 



The general solution of this partial differential equation is: 

r N>v- 

F (s;t ) = [c, (.s-O e ° * C z s \ 



where and C 2 are arbitrary constants to be determined from the 
conditions : 

O)F(sjt) ) t _ 0 = 1 

(2)F(s;t) ) s=0 = 1 

From the equation for F(s;t), it is observed that for the expression 
to be usable, the integral of l'' (t ) must exist. 

Let: 

t 

K(t) = f K(u) du 
0 

This definition of K(t) implies that: 

K(t) ) t=0 = 0 
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Then the solution of F(s;t) is: 



F(sjt) = { C ,-s) 

- V SO - 



This is the probability generating function of a binomial distribu- 
tion with p = 1 - e~^ ^ ^ and 1 - p = e “K(t)^ Then the marginal probabil- 
ity mass function Y(t) when the nonrepairable failure rate is a function 
of time is : 



? x \ -O 



C5) O 



- 







* 



Because of the nature of the death phase of the model, the equations 
for the time-dependent nonrepairable failure rate may be substituted into 
all the equations derived for the general model. This is done by substi- 
tuting the term e“^^ ^ for e" ^ in any equation where it appears and 
writing the nonrepairable failure rate as a function time <5(t) where it 
appears . 
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Appendix B 

Derivation of the Model of a System with Limited Maintenance with Spare 
Units Available 

Consider the system shown in Figure B.1 . This system consists of 
m + n particles. Initially, m particles are in box E, n particles are 
in box D and no particles are in box C. The operation of the system is 
such that, during any infinitesimal period of time, dt, any particle in 
box E has probability (K dt of moving to box C, where ^ is a constant, 
independent of time. When a particle moves from box E to box C, a par- 
ticle moves from box D to box E to replace it so as to keep the number 
of particles in box E equal to m. Clearly the number of particles in 
box E will equal m until all n particles in box D have been exhausted, 
replacing particles in box E. This will occur when there are n particles 
in box C. Thereafter the number of particles in box E will decrease as 
particles move to box C until m + n particles have moved to box C. With 
the above transition probability, the time any particle remains in box E 
will be exponentially distributed with parameter . 

Fipnre B.1 System Consisting of m + n Particles 




Y(t) is a stochastic process describing the number of particles in 
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box C at time t. A system of differential equations will be written de- 
scribing Y(t) at any time t. Therefore the "system probabilities" ares 

P ( y(t) = y ) = p Y (y> t )* To si®P llf y the sys't® 11 of eq^ 10118 ' p ( yjt ^ 

will be used for p Y (y;t). 

The General Equation 

^ p(y; t ) = - m^sp(y;t) + mtsp(y-ljt) 
b t 

Subject to: 0 - 7 - ® 

and p( ^ }t ) = 0 if ^ 0 

5 p(vtt ) = - (m + n - y) ^ p(yjt) 

^t 

+ m + n - (y-1 ) ^ p(y-1 » t ) 
subject to n + 1 A y t m 

The initial condition imposed on the system of differential equations 

is that Y(0) = 0. Thus: P( Y(0) = 0 ) = p( 0; 0) = 1 . 

Although the system of equations can be solved by probability gener- 
ating functions, the mathematics involved are complex because a simple 
partial differential equation is not obtained by the method used in Appendix 
A. Instead this system will be solved by successive solving of each equa- 
tion starting at p( 0j t). With this approach, each successive equation 
uses the results of the solution of the previous equation and becomes a 
linear, first-order differential equation of the form: 

+ R(x)y = Q(x) 
ax 

The solution of this type differential equation is: 

y= s vuo** ^ J e V C j 

In this equation, C is an arbitrary constant which is determined from 
the initial conditions. 
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Using this solution of a differential equation, the system of differ- 



ential equations can be solved. The solution is: 
p(y;t) = 



p(n<-1 jt ) = 






V. 



x e" ^ * 



O t t x 









j - O ^ \ 



p(n+2;t ) = 



•w x - - 1 ) 



l ^ 



- ^ \ 
‘ ) 



I - 



•>'» i 



A VV \ ' 



v, - c 



■,r 



- 7 



All the marginal probabilities are not solved because of the increas- 
ing length of each successive probability statement. The following general 
formula may be used to solve p( n+j j t) given p( n+j-1; t) for all j such 
that 0 *= j 4= m. 

- ^'rr > - ^ ) tf. 

p(n+j;t) = |_m - (j-l)] <s <? 

^ e ^ P i. v, -v \>- \ ■, t 'i d-x 

With the marginal probability mass function of Y(t) known, the cumu- 
lative probability function of Y(t) is given by: 

y 

P( Y(t) y ) = P Y (y;t) = Y_ Py (v;t) 

v=0 1 

Often it is desired to consider the system from the state of the 
number of particles in box E at time t. To do this, let U(t) be a 
stochastic process describing the number of particles in box E at time t. 
The marginal probability mass function and the cumulative probability 
function of U(t) may be obtained from the probability statements of Y(t) 
and knowledge of the specific values of m and n, using the following 
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expressions : 



n 

P( U(t) = m ) = PyCmjt) = Y. Py(y?t) 

y=o 

P( U(t) = m - v ) = p^m - v;t ) = p^(n + vjt) 

u 

P( U(t ) — U ) = PyCujt) = 1 _ Py(V}t) 

v=0 
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